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Abstract Educators are increasingly being encouraged to im- 
plement evidence-based interventions and practices to address 
the social, emotional, and behavioral needs of young children 
who exhibit problem behavior in early childhood settings. 
Given the nature of social-emotional learning during the early 
childhood years and the lack of a common set of core 
evidence-based practices within the early childhood literature, 
selection of instructional practices that foster positive social, 
emotional, and behavioral outcomes for children in early 
childhood settings can be difficult. The purpose of this paper 
is to report findings from a study designed to identify common 
practice elements found in comprehensive intervention 
models (i.e., manualized interventions that include a number 
of components) or discrete practices (1.e., a specific behavior 
or action) designed to target social, emotional, and behavioral 
learning of young children who exhibit problem behavior. We 
conducted a systematic review of early childhood classroom 
interventions that had been evaluated in randomized group 
designs, quasi-experimental designs, and single-case experi- 
mental designs. A total of 49 published articles were identi- 
fied, and an iterative process was used to identify common 
practice elements. The practice elements were subsequently 
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reviewed by experts in social-emotional and behavioral inter- 
ventions for young children. Twenty-four practice elements 
were identified and classified into content (the goal or general 
principle that guides a practice element) and delivery (the way 
in which a teacher provides instruction to the child) categories. 
We discuss implications that the identification of these prac- 
tice elements found in the early childhood literature has for 
efforts to implement models and practices. 


Keywords Practice elements - Early childhood - 
Social-emotional learning - Problem behavior 


Many states across the USA provide early education programs 
for preschool-age children ages 3—5 years old to foster school 
readiness and reduce school failure. Unfortunately, 14-30 % 
of the children who enter these programs exhibit problem 
behavior (e.g., disruptive behavior; Barbarin 2007) and are 
without age-appropriate social and emotional skills, both of 
which impact their ability to benefit from early educational 
experiences (Feil et al. 2005). As a result, these children are 
at risk for long-term behavioral and academic problems 
(O’Conner et al. 2011). Despite the increased focus on pro- 
viding high quality early childhood education to foster social- 
emotional learning and ameliorate problem behavior, many 
educators in early childhood settings struggle to deliver the 
interactional and instructional supports designed to prevent or 
ameliorate social-emotional learning deficits and associated 
problem behaviors. This has led some researchers to call for 
specific training and supports for early educators focused on 
social-emotional and behavioral interventions (Hemmeter 
et al. 2006). 

A logical choice for improving the quality of early educa- 
tors’ interactional and instructional support for young children 
with chronic problem behavior is for them to implement 
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comprehensive intervention models (i.e., manualized inter- 
ventions that include a number of practice components, hence- 
forth called models) and discrete practices (i.e., a specific be- 
havior or action, henceforth called practices) that target chil- 
dren in early childhood classrooms who demonstrate problem 
behavior and collateral social and emotional needs. The early 
childhood literature includes a few models that meet evidence- 
based criteria (e.g., Incredible Years; Webster-Stratton et al. 
2008), along with other models that have been identified as 
needing additional empirical support to be considered 
evidence-based (e.g., Second Step, Brown et al. 2012). 
Educators also have implemented discrete practices that have 
demonstrated positive social, emotional, or behavioral effects, 
typically through single case experimental designs (e.g., 
precorrective statement, Smith et al. 2010). Although a num- 
ber of models and discrete practices exist, it can be a challenge 
for stakeholders to determine which models or discrete prac- 
tices are the best fit for use with specific children in a partic- 
ular early childhood setting (Powell and Dunlap 2009). This is 
due, in part, to the fact that there is no consensus in the liter- 
ature about operational definitions for the practices that have 
been the subject of study. These definitional issues make it 
challenging to compare and contrast findings across studies 
and make it difficult for teachers to implement practices from 
models or discrete practices with integrity in early childhood 
settings. 

Other fields have attempted to introduce systems for defin- 
ing practices to facilitate communication related to interven- 
tion methodology and findings. In the mental health field, 
researchers have focused on defining practice elements (1.e., 
discrete principles or skills) that compose the models and 
practices evaluated within a specific literature (e.g., Chorpita 
and Daleiden 2009; Garland et al. 2008; Institute of Medicine 
2015). The practice element approach, also called “therapeutic 
strategies” (1.e., goal or general principle that guides 
psychosocial treatment; Beutler and Baker 1998) and 
“evidence-based kernels” (i.e., units of behavior influence 
that cannot be reduced further without losing their function; 
Embry and Biglan 2008), presents a different perspective on 
how the evidence base can be defined and employed (Chorpita 
and Daleiden 2009; Chorpita et al. 2005; Garland et al. 2008). 
Instead of a focus on implementing practices from a single 
model, the elements approach argues for the efficiency of 
focusing on specific practice elements that are made from 
the practices used to create the models. In recent years, this 
approach has gained traction, as some assert that creating a 
common way to define the practices within a body of literature 
is key for implementation efforts (Fairburn and Patel 2014; 
Institute of Medicine 2015). 

Two methods have been used to analyze the evidence base 
to identify practice elements in the mental health field. One 
approach developed by Chorpita and colleagues started with a 
codebook of predefined practice elements derived through 
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stakeholder input, including practitioners and intervention de- 
velopers (see Chorpita et al. 2005; Chorpita and Daleiden 
2009). The set of practice elements was then compared to 
models for youth with emotional and behavioral problems, 
and the presence of those elements was coded. This approach 
is useful for cataloging the extent to which a set of common 
practice elements is represented across a broad literature. 
However, given that the practice elements are largely 
predetermined, this approach may not capture all practice el- 
ements within a given literature (Garland et al. 2008). 

A second approach developed by Garland et al. (2008) 
starts without an explicit set of practice elements and works 
to extract practice elements from a target literature. In their 
paper (Garland et al. 2008), they focused on studies evaluating 
evidence-based programs (i.e., models that meet defined 
levels of empirical support) for youth aged 4-13 years old 
displaying disruptive behavior problems. Through successive 
iterative steps, they extracted 21 practice elements from eight 
studies. The approach demonstrated by Garland et al. is more 
likely to identify the full range of practice elements represent- 
ed in a literature. 

A comparison between the two approaches reveals some 
similarities. The seven most commonly represented practice 
elements identified by Chorpita et al. (2005) for disruptive 
behavior problems were mapped on to the list of practice 
elements produced by Garland et al. (2008). However, 
Garland et al. produced a more expansive list, likely due to 
their focus on identifying the full set of practices found in the 
empirical literature. Of course, the ideal number of practice 
elements identified may vary by the purpose. In some in- 
stances, knowing the entire range may be needed, whereas 
in other contexts, knowing a smaller set may prove more 
useful. 

We are not aware of efforts to identify practice elements in 
the early childhood intervention literature for children who 
demonstrate social-emotional difficulties and problem 
behavior. An approach like Garland et al. (2008) took has 
several advantages as a first step in identifying practice ele- 
ments in this literature. First, as noted earlier, there are no 
commonly accepted definitions for the social-emotional and 
behavioral practice elements used in early childhood class- 
rooms that could be used to guide the development of a code- 
book. Second, we were interested in identifying all of the 
practice elements evaluated in the early childhood literature 
for models and practices designed to address social-emotional 
deficits and problem behaviors. Thus, we employed an ap- 
proach most similar to the one used by Garland et al. to define 
practice elements. 

We applied a modified version of the Garland et al. (2008) 
approach to identify practice elements in the early childhood 
social-emotional and behavioral intervention literature. Our 
primary goal was to determine if it was possible to extract 
and define a set of practice elements that represent the models 
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and practices studied in the early childhood literature. We 
describe the process used to identify studies focused on 
models and practices that target young children aged 3-5 years 
old who have social, emotional, and behavioral learning needs 
and to distill from these studies common practice elements. 
Importantly, unlike previous efforts to identify practice ele- 
ments in the mental health field, we did not attempt to differ- 
entiate practice elements by level of empirical support or ex- 
clude studies that failed to achieve positive effects. This deci- 
sion was made based on the challenges of attempting to syn- 
thesize findings across group experimental and single-case 
research designs (see Shadish et al. 2015). This would require 
us to resolve challenges related to a quantitative synthesis of 
the data produced by the two research designs reviewed for 
this paper, which is beyond the scope of the current manu- 
script. Instead, we identified the practice elements found in the 
models and practices listed as having empirical support on the 
What Works Clearinghouse (ies.ed.gov/ncee/wwe/); 
Collaborative for Academic, Social, and Emotional Learning 
(CASEL; www.casel.org/preschool-and-elementary-edition- 
casel-guide); and Blueprints for Healthy Youth Development 
(www.blueprintsprograms.com/) in order to highlight those 
practice elements that are associated with agreed upon 
standards of evidence in the field. 


Method 
Selection of Studies 


We conducted a literature search of published articles evalu- 
ating models or practices delivered in early childhood class- 
rooms targeting young children with chronic problem behav- 
ior. A computer-based search was conducted using four elec- 
tronic databases: (a) Education Research Information Center 
(ERIC), (b) PsycINFO, (c) Elton B. Stephens Company 
(EBSCO), and (d) Web of Knowledge (Social Science 
Citation Index). The search spanned January 2005 to August 
2014; these dates were chosen to correspond with the 2005 


ERIC (N = 868) 


Fig. 1 PRISMA flow diagram 
depicting literature review results. 
This figure illustrates the results 
of the literature review and 
inclusion process 


EBSCO (N = 2810) 
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publication of the National Research Council report that 
sought to advance scientific research in education, with a spe- 
cific focus on evidence-based education (National Research 
Council 2005). The following search terms were used in each 
database: (engage* OR “on task” OR “off task” OR 
complian* OR noncomplian* OR behavior OR behaviors 
OR aggress* OR disrupt* OR problem* OR challeng* OR 
regulat* OR affect* OR social* OR emotion*) AND (inter- 
vene* OR treatment* OR therapy OR prevent*) AND (child* 
OR preschool*). Relevant reviews and meta-analyses (e.g., 
Barton et al. 2014; Carter et al. 2011; McCabe and Altamura 
2011) were used to initiate literature trails. The search yielded 
10,363 unique hits. We reduced the number of articles to 228 
by reviewing the title and abstract and excluding studies that 
did not focus on models or practices delivered in early child- 
hood classrooms. We obtained the full-text version of the 228 
articles and determined that 49 articles met inclusion criteria 
(see Fig. 1). Studies included in the review are denoted with 
asterisks in the “References” section. 


Inclusion and Exclusion Criteria 


To be included, a study had to meet five criteria. First, the 
study had to include a model or practice designed to target 
one or more of the following child outcomes: teacher-child 
relationships, social skills (peers), social skills (adults), prob- 
lem and/or challenging behavior, self-regulation, emotion 
identification, emotion expression, social problem solving, 
or engagement (i.e., task-oriented behavior). Second, the mod- 
el or practice had to be delivered at a school or early childhood 
program. We did not include interventions tailored to an indi- 
vidual child that would not generalize across children (e.g., 
function-based interventions; LeGray et al. 2010). Third, the 
model or practice had to be evaluated using one of the follow- 
ing designs: (a) randomized controlled trial, (b) quasi- 
experimental group comparison design in which groups were 
matched or tested for differences, or (c) single-case experi- 
mental designs (e.g., ABAB/reversal, multiple baseline, 
changing criterion, and alternating-treatment designs). 


PsycINFO (N = 1802) Web of Knowledge (N = 4883) 


Randomized controlled trials (n = 29) Single case experimental designs (n = 13) 
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Fourth, at least one participant had to be preschool age (i.e., 3— 
5 years old). Finally, the study had to be published in English. 


Coding of the Studies 


We first focused on extracting individual practices from each 
study. We defined practice as a specific statement, behavior, or 
action of a teacher that manipulates features of the physical, 
temporal, interactional, or instructional environment in the 
classroom to promote child adaptation, behavioral compe- 
tence, or learning. To extract practices, we sought to obtain 
the intervention manual if one existed. If the manual was not 
available, we relied on the most thorough description of the 
model provided in the published literature (e.g., description of 
the model). If such a source did not exist, we relied on the 
description provided in the article. In all, we relied upon 32 
unique sources (7 =3 manuals and n= 29 articles) to code 
practices. Each intervention manual and article was double 
coded; disagreements were resolved via discussion. 

Each practice was coded along the three dimensions: (a) 
Target goal, the domain of functioning targeted by the practice 
(1.e., teacher-child relationships, social skills (peers), social 
skills (adults), problem and/or challenging behavior, self-reg- 
ulation, emotion identification, emotion expression, social 
problem solving, and/or engagement); (b) Unit, the compo- 
nents, features, or active ingredients that are a major part of a 
practice designed to promote child adaptation, behavioral 
competence, or learning. Units (e.g., emotional regulation 
training, social skills training) are typically composed of mul- 
tiple practices. This dimension was only coded when appro- 
priate (i.e., both the practice and the unit level were identified); 
and (c) Practice. 


Translating Practices into Practice Elements 


We took the extracted practices and grouped together the prac- 
tices that were the same. We then combined the remaining 
practices to form practice elements via an iterative process. 
We defined practice elements as discrete practices, principles, 
or skills that comprise the models (see Chorpita and Daleiden 
2009; Garland et al. 2008). Practices that targeted the same 
domain of child functioning via the same mechanism were 
grouped together to form single practice elements. For exam- 
ple, practices such as “behavior specific praise” and 
“descriptive praise” were grouped under the practice element 
“praise” (see Supplemental Table | in online material for how 
the praise, emotion regulation, and tangible reinforcement 
practice elements were created). Once the initial list of practice 
elements was produced, we grouped them into two categories 
(Garland et al. 2008): (a) Content, defined as the general prin- 
ciple that guides a practice; and (b) Delivery, defined as the 
way in which a teacher provides instruction to the child. 
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Expert Review 


We surveyed five experts in early childhood education with 
experience developing or evaluating interventions for young 
children with social-emotional learning needs and problem 
behavior. Four experts received a PhD in education (75 % 
early childhood special education, 25 % special education) 
and one received a PhD in clinical/community psychology. 
All experts were employed in academic university settings 
(80 % Full Professor, 20 % Research Scientists). Two experts 
were co-authors of this paper and provided feedback after the 
practice elements were identified, defined, and extracted. 
None of the experts were authors of any of the models or 
practices included in the review. A survey was created by 
the first three authors, which included the name and definition 
of the 24 practice elements. Experts were asked to rate each 
practice element as to its relevance for use as a practice for 
addressing young children’s social-emotional learning needs 
and problem behavior in early childhood classrooms. Ratings 
included (a) “not necessary” to use in early childhood class- 
rooms; (b) “useful”, but not essential to use in early childhood 
classrooms; or (c) “essential” to use in early childhood class- 
rooms. The experts were asked to comment on each practice 
element and suggest additional practice elements missing 
from the list. For three practice elements, one respondent did 
not provide ratings. The criterion for retention of the elements 
was a useful or essential rating by at least 75 % of respondents. 


Finalization of Practice Elements 


The quantitative and qualitative feedbacks from the experts 
were reviewed, and consensus was reached on the final item 
list. This work included producing final definitions for each 
item. 


Results 


A total of 475 practices were extracted from the manuals 
(n=3) and articles (n=29). Redundant practices were 
grouped, which produced an initial list of 56 practices. 
These 56 practices were then transformed into practice ele- 
ments via an iterative process (see Supplemental Table 2 in 
online material), which produced a list of 24 practice elements 
divided into content (emotion regulation, problem solving, 
promoting behavioral competence, promoting teacher-child 
relationship, social skills) and delivery (choices, differential 
reinforcement, error correction, ignoring, instructive 
feedback, modeling, monitoring, narrating, opportunities to 
respond, praise, precorrection, premack statements, 
rehearsal, rules, scaffolding, supportive listening, tangible 
reinforcement, time-out, visual cues) categories. 
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We submitted the 24 practice elements to the experts (see 
Table 1). Fourteen items were rated as essential to use in early 
childhood classrooms (choices, emotion regulation, error cor- 
rection, ignoring, instructive feedback, modeling, opportuni- 
ties to respond, praise, premack statements, problem solving, 
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promoting behavioral competence, promoting teacher-child 
relationship, scaffolding, social skills). Three items were rated 
as essential by four of five experts and useful by one of five 
experts (differential reinforcement, monitoring, rehearsal). 
One item was rated as essential by three of five experts and 


Table 1 Common practice elements, definitions, expert ratings, and frequency counts 


Item name Definition Not Useful, but not Essential Freq. 
necessary _ essential (%) (%) 
(%) 
Content items 
Emotion Instruction focused on identifying/labeling (e.g., 1 am happy, I am mad, I am sad) 0 0 100 13 
regulation®® or regulating emotions. 
Problem solving*’* Instruction focused on skills designed to bring about solutions to social, emotional, 0 0 100 10 
or behavioral problems. 
Social skills** Instruction focused on prosocial behavior (e.g., friendship skills, social etiquette, 0 0 100 10 
sharing, taking turns) with peers. 
Promoting Instruction that focuses on setting classroom behavioral expectations, using strategies 0 0 100 5 
behavioral to manage child behavior or promoting positive behavioral engagement in 
competence* instructional activities. 
Promoting teacher- Teacher behavior that conveys warmth, closeness, and interest when listening to and 0 0 100 5 
child relationship interacting with a child. 
Delivery items 
Praise*?* Teacher provides positive verbal statements of approval in response to an appropriate 0 0 100 15 
social, emotional, or behavioral response. 
Tangible Teacher gives a tangible reward or a representative reward in response to an appropriate 0 60 40 14 
reinforcement®” social, emotional, or behavioral response. 
Rehearsal*” Teacher encourages a child to practice an appropriate behavioral skill (e.g., sharing 0 20 80 12 
during interactions with peers). 
Modeling*?* Teacher demonstrates or has a peer demonstrate, a skill to promote learning. 0 0 100 11 
Opportunities to Teacher uses questions or prompts (i.e., gestural, verbal, visual) that seek an active, 0 0 100 10 
respond* observable, and specific response from a child. 
Rules* Teacher uses prescribed guidelines to teach the rules and behavioral expectations 0 25 75 8 
of the classroom. 
Instructive Teacher provides extra instructional information while responding to a correct response 0 0 100 5 
feedback* or appropriate behavior. 
Narrating Teacher provides a verbal description of a child’s behavior. 0 60 40 5 
Choices" Teacher provides a child the opportunity to select between two or more equally desirable 0 0 100 3 
options related to instructional activities. 
Ignoring*”* Teacher ignores undesirable behaviors. 0 0 100 3 
Differential Providing attention and/or praise to other children in order to remind a specific child ofa 0 20 80 3 
reinforcement” behavioral expectation. 
Supportive Teacher conveys understanding for the topic a child is discussing. 0 25 75 3 
listening* 
Time-out™?* Teacher removes a child from an activity for a specified period of time following a 0 40 60 3 
problem behavior. 
Error correction* Teacher provides corrective feedback following an incorrect response or undesirable 0 0 100 2 
behavior. 
Monitoring* Teacher actively monitors a child. 0 20 80 2 
Precorrection* Teacher uses prompts (i.e., gestural, verbal, visual) in advance of a child responding to 0 25 75 2 
remind a child of appropriate behavior and correct responding (rules, expectations, 
routines) before a problem behavior occurs. 
Premack Teacher uses “‘if-then” statements to establish behavioral contingencies between two 0 0 100 2 
statements” child actions or behaviors. 
Scaffolding* Engaging in a collaborative instructional method designed to facilitate learning thatis 0 0 100 2 
appropriate for the child’s cognitive and language developmental level. 
Visual cueing Teacher uses visual cues to prompt a child for appropriate behavioral responses 0 25 75 2 


or consequences. 


N=S5 for all items with the exception of precorrection, rules, and supportive listening. For those items, N = 4 


Freq. frequency 
“Common practice element found in evidence-based model 
> Common practice element overlaps with Garland et al. (2008) 


“Common practice element overlaps with Chorpita and Daleiden (2009) 
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useful by two of five experts (time-out). Two items were rated 
as essential by two of five experts and useful by three of five 
experts (narrating, tangible reinforcement). Four items were 
rated as essential by three of four experts and useful by one of 
four experts (precorrection, supportive listening, rules, visual 
cues). Given that the experts rated all of the items as useful or 
essential, we retained all of the practice elements. Three prac- 
tice elements were modified, however, based upon expert 
feedback: promoting behavioral competence, precorrection, 
and rules. 

Table | provides definitions and frequency counts of the 24 
practice elements. To identify practice elements found in 
evidence-based models and practices, we searched the (a) 
What Works Clearinghouse (ies.ed.gov/ncee/wwe/), (b) 
Blueprints for Healthy Youth Development (www. 
blueprintsprograms.com/), and (c) CASEL (www.casel. 
org/preschool-and-elementary-edition-casel-guide). Social 
skills training was listed on What Works Clearinghouse; 
Incredible Years (Webster-Stratton, C et al. 2008), PATHS 
(Domitrovich et al. 2007), and Tools of the Mind (Barnett 
et al. 2008) were labeled effective on CASEL; Head Start 
REDI (Bierman et al. 2008), and /ncredible Years were listed 
as “promising” on Blueprints. Twenty of the 24 practice 
elements were included in Incredible Years, the only model 
listed on multiple lists (see Table 1). Lastly, we examined how 
delivery items grouped in the five content domains (see 
Supplemental Table 3 in the online materials). 


Discussion 


The purpose of this paper was to describe the iterative process 
used to identify common practice elements of models and 
practices designed to target the social, emotional, and behav- 
ioral needs of young children who exhibit problem behavior. 
Utilizing a process described by Garland et al. (2008), we 
performed a comprehensive literature review, coded the iden- 
tified literature, and consulted with experts. We identified a 
total of 24 practice elements that describe a range of practices 
used in early childhood classrooms to ameliorate problem 
behavior and improve social-emotional outcomes. The list of 
24 practice elements represents an initial step in an effort to 
address some of the definitional issues in the field. 

It is important to consider how our list compares with pre- 
vious efforts to define practice elements in the mental health 
field as well as the implications such a list can have for efforts 
to implement these practices in early childhood settings. There 
is some overlap between our list of 24 practice elements and 
the lists produced by previous efforts to identify practice ele- 
ments in psychosocial treatments for disruptive behavior 
problems (Chorpita et al. 2005; Chorpita and Daleiden 2009; 
Garland et al. 2008). Garland et al. (2008) identified a total of 
21 practice elements and little less than half overlapped with 
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our list (see Table 1). Of the 20 most frequent practice ele- 
ments identified by Chorpita and Daleiden (2009) in psycho- 
social treatments for disruptive behavior problems, a little less 
than half of them overlapped with our list (see Table 1). So 
even though these efforts focused on mental health interven- 
tions, there is overlap in the practice elements identified by the 
three approaches. The overlap seen across these three inde- 
pendent efforts provides some preliminary validity to the 
overall approach of identifying practice elements. 

As the previous efforts to identify practice elements fo- 
cused on psychosocial treatments, it is not surprising (and 
perhaps encouraging) that we identified some unique practice 
elements. Unique practice elements identified in our study 
may reflect developmental differences (i.e., practice 
elements targeting outcomes of young children in our study 
versus older children in Garland et al. 2008 and Chorpita and 
Daleiden 2009) as well as contextual needs of stakeholders 
(.e., teachers delivering practice elements in the classroom 
versus practitioners delivering interventions in clinical set- 
tings). Specific delivery items identified in our review that 
were not found in either of the previous efforts such as active 
supervision, precorrection, and rules may reflect the needs of 
teachers to promote and manage the behavior of young chil- 
dren who exhibit problem behavior within classroom con- 
texts. Unique items such as opportunities to respond may re- 
flect teachers’ attempts to provide learning opportunities to 
monitor child progress in the classroom as well as to promote 
child engagement in individual and group learning formats. 

Our ability to identify practice elements has research and 
practical implications. This list could help inform efforts to 
develop quality indicators (i.e., a measure of the quality of 
early childhood classrooms) for the delivery of practices 
targeting social, emotional, and behavioral outcomes in early 
childhood classrooms. In mental health, some efforts to im- 
prove care have focused on identifying quality indicators em- 
bedded in a quality of care framework (McGlynn et al. 1988). 
Quality of care research seeks to improve the outcomes of 
individuals by studying how structural elements (e.g., contex- 
tual elements including attributes of settings, clients, and pro- 
viders) and processes of care (e.g., activities and behaviors 
associated with giving and receiving care) influence 
outcomes. In this framework, identifying quality indicators is 
an important prerequisite for engaging in quality improvement 
(Garland et al. 2010; Pincus et al. 2011). This is because qual- 
ity indicators provide the means to assess, track, and monitor 
the performance of providers relative to recommended prac- 
tice in the field (Hussey et al. 2007). 

Of course, an important step in identifying quality indica- 
tors is determining the practice elements linked to key out- 
comes, a point that highlights a limitation of our review. 
Unlike previous efforts to identify practice elements (e.g., 
Chorpita and Daleiden 2009; Garland et al. 2008), we did 
not take strength or level of evidence into account when 
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identifying models or discrete practices as part of the literature 
review. We opted to take this approach because it allowed us 
to use a larger dataset to begin developing a set of practice 
elements in the field of early education. That said, 20 of the 24 
practice elements were found in an evidence-based model, 
suggesting that most practice elements have empirical sup- 
port. An important future direction will be to accumulate more 
evidence regarding the empirical support for the individual 
practice elements. In the long term, it will be important to 
winnow the set of practice elements using level of evidence. 
However, doing so will require producing effect size estimates 
across single case experimental designs, quasi-experimental 
designs, and experimental group designs, which represent a 
challenge for the field (see Shadish et al. 2015). It will be 
important to negotiate this hurdle so that work toward synthe- 
sizing the literature across the various research designs can be 
made, which will aid in the process of identifying quality 
indicators with clear empirical support. 

Turning to applications of the practice elements we identi- 
fied, it may be possible to train teachers to use them as a part of 
efforts to improve the process quality in classroom settings. 
We identified 24 practice elements suggesting that there may 
be a relatively short list of practices in the early childhood 
literature that pertain to young children’s problem behaviors 
and social-emotional learning. Most models and practices ev- 
idenced substantial overlap, suggesting that training teachers 
to use a relatively short number of practice elements would 
cover most of the content found in existing models. Moreover, 
most delivery items clustered within a few content domains, 
suggesting that it may be possible to select particular practice 
elements based on the area of child need being targeted. This 
helps to illustrate why some have suggested that adopting a 
practice element framework for implementation efforts can be 
more cost effective and scalable than relying on purveyor- 
driven models (e.g., Chorpita and Daleiden 2009). 

Our results could also inform the development of treat- 
ment integrity tools capable of supporting implementation 
efforts. Some have suggested that treatment integrity in- 
struments used in implementation research should focus 
on three components (Bellg et al. 2004; McLeod et al. 
2013): treatment adherence (prescribed interventions), 
treatment differentiation (proscribed interventions), and 
competence (quality of prescribed interventions). These 
treatment integrity components encompass the core com- 
ponents involved in the implementation of practice ele- 
ments as each plays a critical role in fostering positive 
outcomes in young children (Durlak 2010). However, to 
our knowledge, there are no treatment integrity instru- 
ments in the early childhood education field that assess 
all three components and have utility for use within an 
implementation science framework (Sutherland et al. 
2013). Most existing instruments are designed to assess 
treatment adherence; however, in implementation 
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research, it is important to assess multiple treatment in- 
tegrity components (McLeod et al. 2013; Sutherland et al. 
2013). The 24 practice elements identified herein could 
form the items of an integrity instrument capable of 
assessing treatment adherence and differentiation as well 
as allow researchers to characterize the instructional prac- 
tices delivered in business-as-usual classrooms. Thus, it is 
possible to use these practice elements as items for an 
integrity instrument for early childhood classrooms. 

Though our approach to identifying practice elements had a 
number of strengths, a few limitations should be recognized. 
First, a small number of experts were used to help establish the 
content validity of the practice elements, and it is possible that 
a larger number of experts may have suggested the addition of 
more items. Second, it is possible that there may be some 
practice elements included in the models that were not written 
in the manuals or articles. It could be the case that the descrip- 
tion of the practices was mostly limited to those that repre- 
sented the main focus of study and that some practices were 
not explicitly described. 

In summary, by using a practice element framework we 
were able to identify 24 common practice elements that appear 
in comprehensive intervention models or that are discrete 
practices targeting social, emotional, and behavioral needs of 
young children who exhibit problem behavior. On the one 
hand, this process has implications for improving educational 
services to these children through training and implementation 
efforts. On the other hand, the practice elements framework 
may be useful for researchers, policy makers, and practitioners 
as we search for efficient and effective ways to serve children 
and youth who are most vulnerable. 
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